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Abstract 



1/^ ' We establish an achievable rate region for discrete memoryless interference relay channels that consist 

of two source-destination pairs and one or more relays. We develop an achievable scheme combining 
Han-Kobayashi and noisy network coding schemes. We apply our achievability to two cases. First, we 
characterize the capacity region of a class of discrete memoryless interference relay channels. This class 
naturally generalizes the injective deterministic discrete memoryless interference channel by El Gamal 
and Costa and the deterministic discrete memoryless relay channel with orthogonal receiver components 
by Kim. Moreover, for the Gaussian interference relay channel with orthogonal receiver components, we 



> 

in 

, show that our scheme achieves a better sum rate than that of noisy network coding. 



I. Introduction 

Discrete memoryless interference channel (DM-IC) was introduced by Ahlswede IT]. Discrete memo- 
ryless relay channel (DM-RC) was tirst studied by van der Meulen 0. Neither the capacity region of the 
^ I DM-IC nor the capacity of the DM-RC has been characterized yet except for some special cases. First, 

for DM-IC, the best known inner bound was obtained by Han and Kobayashi |[3l- This inner bound was 
shown to be tight for the injective deterministic DM-IC by El Gamal and Costa lH. On the other hand, 
one relaying strategy for DM-RC is compress-and-forward (CF) due to Cover and El Gamal ||5] where 
the relay compresses its observation and forwards it to the destination. CF was shown to be optimal for 
the deterministic DM-RC with orthogonal receiver components ||6l and the modulo-2 sum relay channel 
Q. Recently, noisy network coding ||8l generalized CF for general discrete memoryless relay networks. 

A natural next step is to extend these results to more general channel scenarios in which there are 
more than two transmitter-receiver pairs and/or relays. As one model, we consider a discrete memoryless 
interference multi-relay channel (DM-IMRC) that consists of two source-destination pairs and an arbitrary 
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number of relays. For this channel, we combine Han-Kobayashi and noisy network coding schemes 
to establish an achievable rate region. We apply our result to two cases. First, we characterize the 
capacity region of a class of a discrete memoryless interference relay channel (DM-IRC) which naturally 
generalizes the injective deterministic DM-IC by El Gamal and Costa |[4l and the deterministic DM-RC 
with orthogonal receiver components by Kim For the converse, a genie-aided proof technique is used. 
Furthermore, for a Gaussian interference relay channel (GIRC) with orthogonal receiver components, we 
show we can obtain a better sum rate than that in ||8]. 

The rest of the paper is organized as follows. In Section HI] we introduce the DM-IMRC model. Section 
Hm presents the achievable rate region for the DM-IMRC. Section |IV] characterizes the capacity region 
of a class of DM-IRC. Section [Vl focuses on the GIRC with orthogonal receiver components. 

II. Model 

We consider a DM-IMRC as depicted in Fig. [T] A (2"^^ , 2"^^ , n) code consists of two message sets 
Ml = {!,..., 2"^i} and M-2 = {!,..., 2"^^}, two encoding functions at the sources where the first 
source (node 1) maps its message mi € TWi to a codeword x"(mi) € -Y" and the second source (node 
2) maps its message m2 G to a codeword ^2 (?Ti2) G N processing functions at the relays (node 
3,/c where A; € [1 : A^]) that map each past received symbols yg'^^ € 3^3"^,^ to a symbol X3^k,i{yl~k) G '^3,k^ 
and two decoding functions at the destinations where the first destination (node 4) maps each received 
sequence 7/4 G to a message estimate ?ni and the second destination (node 5) maps each received 
sequence y'^ G to a message estimate m2- The first source (node 1) chooses an index mi uniformly 
from the set ^Al and sends x"(mi) and the second source (node 2) chooses an index m2 uniformly 
from the set A42 and sends (m2). The average probability of error for a (2"^i , 2"^= , n) code IS given 
as Pi"^ = Pr ^(Mi,M2) 7^ {Mi, M2)^ . A rate pair {Ri,R2) is said to be achievable if there exists a 
sequence of (2"-^i , 2"^= , n) codes such that pj"^ as n — > CX3. The capacity region C is the closure 
of the set of achievable rate pairs {Ri,R2). 

III. Main results 

An achievable rate region for the DM-IMRC is established in the following theorem. 

Theorem 1: A rate pair i?2) is achievable for the DM-IMRC if there exists some probability mass 
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Fig. 1. A discrete memoryless interference multi-relay channel (DM-IMRC) 



function (pmf) p(g)p(ni,xi|g)p(u2,X2|g) 11^=1 P(^3,fc 1 9)p(y3,fc 1 2/3,fc, 2:3^^,5) such that 

Ri < mm{/(Xi , X3 (5) ; (5^) , , X3 (5^) ) - /(Ys (5) ; (5) 1^1 , , , (5'=) , n) } 

i22 < mm{/(X2 , Xa (5) ; ^3 (S") ,¥5^1, XsiS')) - I{% (S) ; ^3 (5) 1^2 , C/i , ^3^ , ^3 (5^) , n) } 

Ri + R2< mm{/(Xi , X3 (5) ; % {S") ,Yi\Ui,U2, XsiS')) - /(I3 (S) ; (S) |Xi , f/2 , ^3^ , y3 (5') , n)} 

+ min{/(X2 ,Ui,X3 (S) ; 1^3 (S^) , ^5 IX3 (5^)) - /(y3 (S) ; ^3 (S) \X2,Ui, X.^ ,%iS'),Y,)} 

Ri + R2< mm{I{X2 , X3 (5) ; % {S') , I f/i , , X3 (5^)) - /(^ (S) ; ^3 (S) 1^2 , C/i , ^3^ , 1^3 (5') , n)} 

+ mm{/(Xi , 1^2 , X3 (5) ; y3 (S^) , I4 1X3 (5^)) - /(y3 (S) ; ^3 (S) |Xi , [/2 , ^3^ , 

i?i + i22 <mm{I{XiM2,Xs{Sy,Ys{S'),Yi\Ui,X3{S'')) - I{%{S);Y3{S)\X^^ 

+ mm{IiX2,Ui,X3iS);%iS'),Y5\U2,XsiS')) - Ii%iS);YsiS)^^^ 

2R1 + R2 <Tmi,{I{Xi,X^{S)-,%{S'),Y^\UuU2,X^{S'')) - I{%{S)-Y^{^^^ 

+ m.^{I{X^,U2,X^{SyMSl,Y^\X^{S')) - I{%{S)-,Y^{S)\X^,^^^ 

+ mm{/(X2 , f/i , X3 (5) ; %{S') , I f/2, X3 (5^)) - 1(^3 (S) ; ^3 (S) 1^2 , f/i , ^3^ ,%{S''),Y^)} 

Ri + 2R2 < mm{/(X2 , X3 (5) ; % (S^) , I f/i , C/2 , X3 (5^)) - 1(^3 (S) ; ^3 (S) 1^2 , f/i , ^3^ ,%iS'),Y,)} 

+ mm{I{X2,Ui,X3iS);Y3iS'),Y5\X3iS')) - Ii%{Sy,YsiSy^^ 

+ mm{IiXi,U2,X3iSy,%iS'),Y^\Ui,XsiS')) - Ii%iSy,YsiS)\Xi,U2,^ 

for all subsets S C [I : N] such that X3(5) C {^3^1, • • • ,Xs^n} which are relay nodes. 
Proof: See Appendix lAl 

■ 

By letting X = 1 in Theorem [T] we obtain the following achievable rate region for the DM-IRC. 
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Corollary 1: A rate pair {Ri, R2) is achievable for the DM-IRC if 
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for some V'^i p{q)p{ui,xi\q)p{u2,X2\q)p{x3\q)p{y3\y3,X3,q). 



IV. Capacity of a class of injective interference relay channels 

We characterize the capacity region of a class of injective DM-IRCs. In this class, the channel outputs 
are given as follows: 

YA = {YiX) 
Y, = {YlYi') 
Yi = y^{Xi,T2) 
Yl = y5{X2,Ti) 
Y: = Yi' = X3 
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Fig. 2. A class of injective DM-IRCs 



¥3 = MXiX) = f2{X2,Y^) 

where Ti = ti{Xi) and T2 = t2iX2) are functions of Xi and X2, respectively and fi and /2 are 
functions of {Xi,Yl) and {X2,Yl), respectively. The functions ^4 and are injective in ti and 
respectively, i.e., for every xi G Xi, y4ixi,t2) is a one-to-one function of t2 and similarly for y^. The 
relay sends information over a common rate-limited noiseless link of rate Rq = maxp^^^^-^ I{X-y,Yl') = 
maxp(^g) /(X3; yg') to both destinations. This class of DM-IRCs is illustrated in Fig. |2] For the class of 
injective DM-IRCs illustrated in Fig. |2j the following theorem gives the capacity region. 

Theorem 2: The capacity region of the class of injective DM-IRCs in Fig. |2] is the set of rate pairs 
R2) such that 

Ri <mm{H(Yi\T2,Q) + H{Ys\Yl,T2,Q),H(Yi\T2,Q) + Ro} (1) 

R2 <mm{H{Y^\Ti,Q) + H{Y3\Y^,Ti,Q),H{Y^\Ti,Q) + Rq} (2) 

R1 + R2 <mm{H{YsX\TuT2,Q),H{Y;\T^,T2,Q) + Rq} + mm{H{Ys,Y^\Q),H{Y^\Q) + Ro} 

(3) 

R1 + R2 <mm{HiYsX\Ti,T2,Q),H{Y^\n,T2,Q) + Ro} + inm{HiYsX\Q),H(Yi\Q) + Ro^ 

(4) 

R1 + R2 <mm{H{YsX\Ti,Q),H{Yl\Ti,Q) + Rq} + mm{H{YsX\T2,Q),H{Yi\T2,Q) + Ro} 

(5) 

2Ri + R2 <mm{H{YsX\Ti,T2,Q),HiY;\n,T2,Q) + Ro} + mm{H{YsX\Q),H{Y;\Q) + Ro} 

+ min{F(y3, y5'|T2, Q),H{Y^\T2, Q) + i?o} (6) 
R1 + 2R2 <mm{H{YsX\Ti,T2,Q),HiYl\n,T2,Q) + Ro} + mm{H{YsX\Q)^H{Yl\Q) + Ro} 
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Fig. 3. GIRC with orthogonal receiver components 



+ mm{H{Y3X\Ti,Q), H{Yi\Ti,Q) + i?o} (7) 

for some pmf p{q)p{xi\q)p{x2\q). 

Proof: The achievability of Theorem |2] is directly obtained by letting 13 = 13, Ui = Ti, and U2 = ?2 
in Corollary [T] The converse proof is given in Appendix E 

■ 

V. Gaussian interference relay channel with orthogonal receiver components 
Consider the GIRC with orthogonal receiver components in Fig. [3l The channel outputs are 

Ys = 931^1 + 532-^^2 + 

Yi = 941X1 + 942X2 + Z/^ 

K;' = 551^1 +552^2 + ^5- 

where Y[ = (Yi ,Yi"),Y/ and Y" are independent for / = 4, 5, gjk is the channel gain from node k to 
node j and the noise Zj Af{0, 1) is independent and identically distributed (i.i.d.). Relay helps the com- 
munication of two source-destination pairs by forwarding some information about ^3 to both destinations 
through a common rate-limited noiseless link of rate Rq = maxpf^^^^ li^s', Y^') = maxp(^3) /(X3; yg"). 

We consider Pi = P2 = P, Xi = Ui + Vi, X2 = U2 + V2 and Ui, Vi, U2 and V2 are independent 
where Ui corresponds to the common message and Vi corresponds to the private message for i = 1 , 2 
and power is allocated as Pu, = (1 — ai)P, Py, = oiiP for i = 1,2. Then, setting ^3 = 13 + ^ with 
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Z ~ A/'(0, cr^) yields the inner bound Tl that consists of all rate pairs (R\^R2) such that 
6iiP + afa2P2 \ 



i?i <C 



^^2 <C 



Vl + c72 + 62iaiPy 



zp , D Aiiaii^ + afaiaai^'A , ^ 621(1 - "i)^ + 622^ + a^P^ 
/tl + /t2 < — 7, ; =; — + L 



V 1 + cr2 + ?)i2a2^' 7 V l + a2 + 62iai^' 

fi. + fi, < C ( - c. + C ( ''^'^ t " - "'i''"^ ) - + 2fl„ 

uaiP + afaia2P' ^ ^ ^ ( gl^P + {\ - ax)gl^P \ 



i?l + i?2 < C 



i^l + i?2 < C ''^'^^^ " "'^^ + ^''^ + 



l + o-2 + 62iaiP 



l + cr2 + 62iaiP / V l + a2 + 6i2a2P 



\9iiaiP+lJ V ff|2a2^' + l / 

D , D ^ Ai2(l -a2)P + 6iiaiP + a2aiP2 

Xti + /t2 < 



1 + fj^ + 6i2a2-P 



/ 621(1 - ai)P + 622^2^ + aja2P'^ \ 
^ V l + cj^ + b2iaiP J 



R,+R,<C (^>^''.; - - Ci + C r^^^^"^ V - - C2 + 2Ro 

\ 5|2«2P + i / V aLaiP + i J 

Pi + i?2 < C pi2(l - "2)P + 6iiaiP + afaiP^ \ ^ ^ A5V2P + (1 - aQgji-P A _ + 
^ ^ V 1 + 0-2 + 6i2a2-P / V gii^iP + 1 / 20 

D ,D ^ /62i(l -ai)P + 622a2P + a^a2P^ 
2Pi + P2 < C pii«i-P + Qf«i"2P' \ ^ ^ 612(1 - a2)P + 611P + a2p2 



/ V ff|2a2P + l / 



V l + o-2 + 6i2a2P / V 1 + ^2 + 61202^ 
621(1 - ai)P + 622^2^ + a|a2P^ 



C 



l + f72 + 62iaiP 



2Pi + P2 < C (^>lL\ + c (' gli-P + (l-«2)g4V \ ^ c ^^i2«2P + (1 - ai)5ii^^ 



V542"2P+1/ V 542"2P + 1 / V 95l"l^+l 
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+ 3-Ro — 2Ci — C2 



+ c 



621(1 - ai)P + b22a2P + aiQ2-P^ 
1 + ^2 + 621"!^^ 



_ ,'6iiaiP + afaia2^^\ , ^ Ai2(l-a2)-P + 6ii-P + a?p2 

Ziti + /t2 < U I — — — + L 



1 + 0-2 + 6i2a2^' / V 1 + ^2 + 61202^ 
( gl^a2P + {I - ai)gl^P 



V gi^aiP+l 



-■2 



2R +R [^ ^""^^^"^"^"^^^ ^ ^ / gliP + jl - a2)gl2P 



1 + cr2 + 61202 / V ffi2a2i' + l 

r gl2a2P + {I - ai) 9lP' 
V ffi^aiP + l 



+ C ( »i,^5i^ +2i?o-gi-g2 



2i?i + i?2 < C / ^ii"i-P + "i"i"2^^ \ _^ (- /^^2i(l - ai)-P + 62202^' + ala2P'^ 



1 + cr2 + 612^2^' / V l + cr2 + 62iaiP 

V 542a2/' + 1 / 

and i2i + 2R2 is bounded by (32)-(37) with indices 1 and 2 switched where C(x) = ^log(l + x), 
ai = 931942 - 932941, 02 = 531552 - 932951, hi = ffii + (1 + o-^)ff|i, bi2 = 9I2 + (1 + 0-^)5|2' 

021 - S-Sl + ll + f^ j551' 022 -532 + 11 + 0^ J552' (-1 - L (g^.a^P+l)^^ )' ^nd G2 - L (gi^a,P+l)a^ ) 

for some cj2 > 0. 



Remark 1: Above inner bound is the same as that achieved by Han-Kobayashi and GeneraUzed Hash- 
and-Forward schemes @ for a GIRC with a digital relay link of rate Rq bits per channel use. 

Remark 2: The sum rates of the proposed scheme is compared with that of |l8l in Fig. |4l The sum-rate 
curve for the noisy network coding from ||8] is obtained by using noisy network coding via simultaneous 
nonunique decoding and that via treating interference as noise. Proposed scheme outperforms these two 
schemes since Han-Kobayashi scheme is more general and includes as special cases both simultaneous 
nonunique decoding and treating interference as noise. 
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Fig. 4. Comparison of two schemes for the GIRC with orthogonal receiver components with 341 = ^52 = 1,(742 = gsi = 
0.4, P31 = 0.5, 532 = 0.1, Ro = l,a^ = 5. 

Appendix 

A. Proof of Theorem [7] 

In this section, (5(e) > denotes a function of e > which tends to zero as e ^ and e„ > denotes 
a function of n which tends to zero as n — 00. Moreover, we define [i : j] = {i, i + 1, . . . , j} where i 
and j are integers. By using the coded time-sharing technique lITOl . achievability with Q can be obtained. 
Hence it suffices to consider the case (5 = 0. Some of our proof steps and notations are based on those 
in Section 6.5 in ifTOl and those in fSl. 

1) Codebook generation: Fix a joint distribution of a;i)p(u2, 3:2) ]^^^ p(2;3,fc)p(y3,fc|y3,fc, a^s^fc). 
Let h denote the number of blocks. For a = 1,2, nia denotes the message for the ath source. For each 
message, we use rate splitting nia = {maQ,maa) where niaQ is the public message at rate RaQ and maa 
is the private message at rate Raa such that Ra = RaO + Raa- Moreover, for /c € [1 : N], l^j denotes the 
kth relay's compression index of its received signal in block j at rate Rs,k- 

For each block j G [1 : b] and each node a = 1,2, randomly and independently generate 2"''^"° length- 
n sequences Uaj{mao),mao € [1 : 2"^^"°], each according to the distribution Yl7=iPUa{'^a,{j-i)n+i)- For 
each TUao, randomly and conditionally independently generate 2"''^"" sequences Xaj{mao,maa),'>T^aa G 
[1 : 2"^^""], each according to the distribution ll'l^^px,\uA^a,U-i)n+i\ua,{j-i)n+i{'mao))- Similarly, 
randomly and independently generate 2"^^ *= sequences x^^kjih,j-i)Jk,j-i S [1 : 2"^-^ ''], each according 
to the distribution ]Xi=iPX3,Ax3,k,{j~i)n+i)- For each X3^kj{lk,j~i),lk,j-~i G [1 : 2"^3 '=], randomly and 
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conditionally independently generate 2"^=' '= sequences yz,kj{lkj\h,i~i),hj € [1 : 2"^=* '=], each according 
to nr=i^'y3,,|X3.*,(y3,fc,0-i)n+i|3^3,fc,0-i)n+i(4,i-i))- The codebook is defined as 

Cj = {uij{mio),U2j{m2o),xij{mio,mii),X2j{m2o,m22),X3^kj{kj-i),y3,kj{hj\h,j-i) ■ 
mio G [1 : 2'^''^-], mil G [1 : 2"^^"],?n2o G [1 : 2"*^™],m22 G [1 : 2"^^-], 

for i G [1 : 

2) Encoding: To send = {mao^maa), source a transmits x2j{mao,maa) in block j. Set I^q = 
l,k e [1 : N] hy convention. Upon receiving y^f^j at the end of block j G [1 : 6], the kih relay finds an 
index Ikj such that 

(y3",,,.(/,,|/fc,,-_i),y3",,,,x^,,,.(/fc,,-_i)) G 7;1"\ 

If there is more than one such index, select one of them uniformly at random. On the other hand, if there 
is no such index, choose an arbitrary index from [1 : 2"^"=] uniformly at random. Then the kth relay 
transmits the codeword a^s fcj(^fej-i) in block j G [1 : b]. 

3) Decoding: Let e > e'. We use simultaneous nonunique decoding. At the end of block b, node 4 
finds the unique message pair (rhio, mu) such that there exist some ?n2o G [1 : 2"''^^"] and {lij, • • • /Inj) 
satisfying 

{uij{mio),U2j{m2o),xij{mio,mii),X3^ij{lij-i), ■ ■ ■ ,X3^Nj{h,N,j-i),m,ij{hj\h,j-i), • • ■ , 

m,Nj{lNj\lN,j-i),yij) G T^"-^ 

for all i G [1 : b], where rfiio G [1 : 2"''^"],mii G [1 : 2"''^"] and ikj G [1 : 2"-^^'"]. Otherwise, it 
declares an error. Similarly, node 5 finds the message pair (77120,77122)- 

4) Analysis of the probability of error: Without loss of generality, assume that the message pair 
((1, 1), (1, 1)) and index l'' = (li, . . . , 1^) = (1, . . . , 1) are sent where Ij = (/ij, • • • , Inj)- Then the 
decoders make an error only if one of the following events occur: 

£1 = {{%,kj{lkj\l),X3,kj{l),Y3,kj) i rf^ for all hj and for some j G [1 : 6],A; G [1 : iV]} 

£2 = {(^7i,(i),c/2j(i),xi,(i, i),x3,i,(i), • • • ,x3,7Vi(i),^:3,ii(i|i), • • • ,%,Nj{i\i),Y^j) i ri") 

for some j G [1 : 6]} 
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^3 = {(Uljil), U2j{l),X2j{l, l),X3,i,(l), • • • ,X3,;vi(l),^^S,l,(l|l), • • • ,r3,iVi(l|l),l5j) ^ Z^""^ 

for some j G [1 : 6]} 

£4 = {{Ulj{l),U2j{l),Xij{l,mu),X^^lj{llj^l),- ■ ■ , X3^7Vj(^7V,j-l), ^3,lj(^ljKl,J-l); ■ • • j 

^3,Afi(^7VjK7V,j-i),>4j) G T^^"-* for all j G [1 : 6] and for some l^mll / 1} 

^5 = {(^Ijl'IT'lo)! f^2j(l),-'^lj("ll05 "T'll);-'^3,lj(^l,i-l)' ■ ■ ■ ) -^^S.TVj (^ATj-l ) ; ^3,lj (^Ij 1^1 J-1 ) ' ' ' ' ; 

l'3,7Vi(/7Vi|/7V,i-i),>4i) G r,(") for all j G [1 : 6] and for some 1 ,mio / l,?nii} 
£e = {iUijil),U2j{m2o),Xij{l,mii),X3^ij{lij_i),- ■ ■ , X3^Nj{lNj_i),Y3^ij{lij\lij_i), ■ ■ ■ , 

Y3,Nj{lNj\lN,j-i),y4j) G 7;^"'' for all j G [1 : b] and for some l^ m2o 7^ / 1} 

£7 = {{Uij{mio),U2j{m2o),Xij{miQ,mu),X3^ij{lij_i), ■ ■ ■ , X3^Nj{lN,j-i),Y3^ij{lij\lij-i), • • • , 

Y3,Nj{lNj\lN,j-i),y4j) G T;^"-* for all j G [1 : b] and for some l^mlo / l,m2o / l,mii} 
^8 = {{Ulj{l),U2jil),X2j{l,m22),X3^lj{llj^l),- ■ ■ ,X3^NjilN,j-i),y3,ij{hj\h,j-i)r ■ ■ ) 

^'3,7Vi(/7Vi|/7Vj-i),ni) G r,(") for all j G [1 : 6] and for some 1 , 77122 / 1} 
^9 = {{Ulj{l),U2j{m2o),X2j{m20,m22),X3^lj{llj^l),- ■ ■ , X3^Nj{lN,j~l),Y3^ij{lij\lij^i), ■ ■ ■ , 

Y3,Nj(.lNj\lN,j~i),Y5j) G for all j G [1 : 6] and for some l^m2o / 1,^22} 

^10 = {(f^li("^lo)5f^2j(l),-'^2j(l,W'22),-^3,li(^l,j-l)> ■ ■ ■ , X3^Nj{iN,j-l),Y3^ij{lij\lij-i), ■ ■ ■ , 

^3,Afi(^7ViK7V,i-i),5^5j) G for all j G [1 : 6] and for some l^mlo / l,m22 / 1} 

^^11 = {(^^Ii("ll0),f^2j("l20),-^2i("l20,"l22),-'^3,li('l,j-l),--- , -'^3,Afj (^TVj-l) , ^3,li (^Ij l^lj-l) , ' ' ' , 

Y3,Nj{lNj\lN,j-i),Y5j) G 7;^") for all j G [1 : b] and for some l^mlo / l,m2o / 1,^22} 
Thus, the probability of error is bounded as 

P{£) <P{£i) + P{£2 n £1) + P{£3 n ) + P(^4) + P(^5) 

+ P{£e) + P{£7) + P{£8) + Pi£9) + P{£io) + P(^^ii). 

By the covering lemma fTOl and the union of events bound over b blocks, P(£'i) tends to zero as 
n ^> 00 if R3^k > -^(^3,fc; ^3,fc|-'^3,fe) + ^(e')i^ G [1 : N]. Next, using the Markov lemma |[T3 and the 
union of events bound over b blocks, the second and third terms P(£'2 n Sf), P{£3 n £f) tend to zero as 
n ^ 00. 

From here, we use similar proof techniques and steps as in ||8l. For the fourth term, by defining the 
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events 

£j{mu,ij~i,ij) = {{Uij{l),U2jil),Xij{l,mii),X3^ij{lij_i), - ■ ■ , X^^NjilNj-i), 
Y3,ij{hj\h,j-i), - ■ ■ ,Y3,Nj{lNj\lN,j-i),Y4j) G 7;^'"^}, 

we can show 

b 

p(^4)=p( u un^^("^ii'W,i.)) 

miiT^l F j=l 
b 

mii^l 1" j=l 

^ E Enp(^^("^"'ij-i'ij))' 

mii^l 10 i=2 

where (a) follows since the channel is memoryless and the codebook is independently generated for each 
block j. 

For each l'' and j G [2 : b], define Sj{l'') = {k e [1 : N] : kj-i ^ 1}. Note that 5^(1^) depends only on 
Ij-i and hence we write it as Sj{lj^i). Define X3j{Sj{lj^i)) to be the set of X^^kjihj-i), k G Sj{lj^i), 
where hj-i is the corresponding element in l''. Similarly define Y3j{Sj{lj-i)) and Ysj{Sj(lj-i)). Then, 
for mil / 1> 

(C7i,(l),?72j(l),Xi,(l,mii),X3j(5,(l,_i)),l3,i(5j(lj~i))) 

n 

~ -Pi7i,Xi (■Ui^(j_i)„+j, Xi^(j_i)„+j)Pc/2 (W2,(j_i)„+i) X 
i=l 

Y\. ^X3,k (^3,fc,(j-l)n+i)-Py3 ,^|X3,fc(^3,fc,(j-l)n+i|3:3,fc,(j-l)n+j) 

is independent of (Xsj (5|(lj_i)), y3j(S'|(lj_i)), l4j). By the joint typicality lemma III Oil or Lemma 2 
in m, we have 

P(^j(mii,lj„i,lj)) < 2-"(^(^^(l-i))-^(^)), 

where 

= /(y4, 1^3(5^); ^1, ^3(S)|C/i, C/2, ^3(S^)) + /(^^s.fc; ^1, f/2, ^3^, I4, 

k&S 
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Furthemiore, by the definition of if mn ^ 1, then 

Ij-i 5C[l:Af] l,-i:S,{l,-i)=5 

5c[l:Af] 

where the minimum is over 5 C [1 : A^]. Hence, 

h 

P(^4)< J]nP(^i("^ii'lj-i'li)) 

1" i=2 

miiT^l U i=2 

< 2"feRii2^"=i"^3-'=2^(^~^) • 2"("(^~^)'^'°^(^('^)~^'=es^-^'''-'^('))), (8) 
where the minimum in (1) is over all C [1 : N\. Then, (1) tends to zero as n — )• oo if 



V \ fees / / fe=i 



for all 5 C [1 : N\ By eliminating i?3 ^ > /(Is^fc; ^3^^1X3 ^) + (5(e') and taking 6 — )• 00, it can be readily 
shown that P(£'4) tends to zero as n — > 00 if 

i2n <mm^(5) - J] /(^g.fc; ^3,fe|^3,fc) " <5'(e) - iV5(e') 
fees 

= mm{/(y4 , % {S')\ Xi , X3 (S) j C/i , ^72 , X3 (5^)) 
fees 

= min{ J(y4 , ^3 (5') ; ^1 , ^3 (S) I f/i , [/2 , ^3 (5') ) 

- 1^3(5)1^1, X^MS'),Y^, Yt^)] - 5'{e) - N5{e') 

kes 

= mm{IiY^,%iS');Xi,X3iS)\Ui,U2,X3iS')) 
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- I{Y,{S);Ys{S)\XuU2,X^ ,Y,{S'),Y,)} - 6'ie) - N6{e') 

for all 5 C [1 : N]. 

Similarly, P{£5),P{£q), and P(^7) tend to zero as n — > oo if the following conditions are satisfied 
respectively: 

Ru + Rio < mmI{Xi,Xs{S);Y3{S'),Y^\U2,X-i{S'')) 

- I{%{S);Y3{S)\Xi,U2,Xi',%{S'),Y^) - 5'(e) - 7V5(e') 
RU + R20 < mmI{Xi,U2,Xs{S);%{S'),Yi\Ui,X3{S'')) 

- I{%iS);YsiS)\X,,U2,Xi' ,%{S'),Y^) - 6'{e) - N6{e') 
Rn + Rw + R20 < min/(Xi, U2, Xs{S);Ys{S''),Y^\Xs{S'')) 

- I{%{S);YsiS)\X,,U2,Xi' ,%{Sn,Y^) - 6'{e) - N6{e'). 

Similarly, PiSs), PiSg), P(^io)> and P{£u) are bounded. Finally, we obtain all inequalities in Theorem 
[T]by substituting Ru = Ri — Riq and R22 = R2 — R20, and applying the Fourier-Motzkin elimination. 

■ 

B. Converse proof of Theorem |2] 

Let Q be a random variable uniformly distributed over [1 : n] and independent of {X^, X2, X^,Y^, Y^, Y^) 
and let Xi ^ Xiq,X2 ^ X2q,X^ ^ X^q,Y^ ^ Y:,q,Y^ ^ Y^q,Y^ ^ Y^q^Ti ^ Tiq, and T2 ^ T2Q. 
The first term in the minimum in (2) in Theorem |2] is obtained as follows. 

nRi <I{Mi;Y^) + nen 

<I{Mi-Y^,Y^) + nen 
<I(X^;Y^,Y,^) + nen 

<I{X^;Y^,Y,^\T^) + nen 
=H{Y^,Y,^\T^) + nen 

n 

= H{Yi,, Yii\Y^~\Yt\T:^) + nen 
1=1 

n 

H{Y^,, Yii\Y^-\Yt\X:i,, T^) + nen 

1=1 
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n 

<J2H{Y4i,Ysi\X3i,T2i)+nen 
1=1 

=nH{Yl Yl', Ys\X-i,T2, Q) + ne„ 

<nH{YlY3\T2,Q) + nen 

=n{H{Yi\T2, Q) + H{Y3\Yi Ta, Q) + e„) 

where Q is the usual time-sharing random variable and (a) follows by the fact that T2 and X" are 
independent. (6) follows since X'^i is a function of ^"3"^. The second term in the minimum in (2) is 
obtained as follows. 

nRi<I{Mi-Y^) + nen 

<I{X^,XS;Y,^\T^)+nen 
= I{X^- Y^\T^, X3") + I{X^-Y^\T^) + nen 
= H{Yt\T^,X^) + liXlX'lT^) +nen 
<n{H{Yl\T2,Q) + Ro + en) 

Similarly, we can obtain inequality (3). Before we prove the remaining terms, we define mutual infor- 
mation terms /i, . . . ,/i2 and show some inequalities for those terms. 

/i = I{Mi;Y^,Y^,T^\T^) < HiTl") + H{Y];,Yr^\T^,T^) 

n 

< H{T^) + Y,{H{YM,Y^^Yt\Yl-\X3,,T^, T^) 

i=l 
n 



< + HiY^i, Yii\Tu,T2^ 



i=l 



H{T^)+nH{Y3X\Ti,T2,Q). 



Next, 



h = I{M2;Y^,Y^) < H{Y^,Y^) - H{Y^,Y^\X1^) 

H{Y^,Yt)-H{T^) 
<nH{Y3,Yl\Q)-H{T^) 

where (a) follows by the channel conditions and the fact that H{YJ^'^ 1X2) = H{T{'). Next, 

Is = I{Mi;Y^, T^\T5) < H{T^) + liX'^ ,X^-Y^\T^ , T^) 
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< H{T^) + nRo + nH{Yl\Ti,T2, Q) 

Next, 

< nH{Yi\Q) - H{T^) + uRq. 
Similarly, 1^,1^, If, Ig are defined as Ii,l2,l3,h with indices 1 and 2 switched. Next, 

jg = i(Mi ; y^", yg-, T^) < y^", yg", ) 

i/(ri") + i7(y3",yr|Tf ) - h{t^) 

n 

= H{T^) + Y,H{Y3^,Y4^\Y^-\Y:-\T^,Xs^) - H{T^) 
1=1 

< H{T^)+nH{Ys,Yi\Ti,Q) - H{T^) 
where (a) follows by the fact that H{Yl''\X'^) = H{T^). Similarly, 

/lo = /(M2; y;", yf, r2") < h{t^) + ^//(ys, yg'iTa, q) - h{t^). 



Next, 



= H{T^') + //(yfirf ) - H{T^) + i/(y4""|Ti",y4'") 



Similarly, 



/12 = /(M2; ys", r2") < H{T^) + nH{Yl\T2, Q) - H{T^) + nR^. 

Then, the remaining terms in Theorem |2] can be proved by using above inequalities for /i, . . . ,/i2- 
Inequality (4) is obtained as follows. 

n{Ri + R2) < min{/(Mi; yr, Y^\ T^\T^, I{Mi;Y,\ Tl^\T^)} 
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+ min{/(M2; yg", n"), ^(^^2; ^T)} + nen 
= min{/i, /s} + min{/2, 14} + ne„ 

< min{F(ri") + nH{Yi, ^'iTi, T2, Q),H{T^) + uRq + nH{Yi\n,T2, Q)} 
+ min{ni7(y3, Ks'lQ) - //(r['), n/7(y5'|Q) - i7(Tf ) + ni?o} + ne„ 
= n{mm{H{Ys, Y^lTi, Ta, Q), //(y^lTi, Ta, Q) + Ro} 
+ mm{H{Y3X\Q),H{Yi\Q) + Ro} + e„). 
Similarly, we can obtain inequality (5) by using I^, Iq, If, Is- Inequality (6) is obtained as follows. 
n{Ri + ^2) < min{/(Mi; Y^^, Tf), /(Mi; y^, Ti")} 

+ min{/(M2; yg", y,", T^), /(M2; yg", r2")} + nen 
= min{/9, 111} + min{/io, /12} + nen 

< mm{H{T^) + nH{Y3,Yl\TuQ) - H{T^),H{T^') + nH{Yl\Ti,Q) - H{T^) + nRo} 
+ min{F(r2") + nH{Y3, Yi\T2, Q) - H{T^),H{T^) + nH{Yi\T2, Q) - H{T^) + ni?o} 
+ nen 

= n(min{F(y3, Yl\Ti,Q), H{Yl\Ti,Q) + i?o} 
+ ia\n{H{Y3,Yl\T2,Q),H{Yi\T2,Q) + Ro} + en). 
Inequality (7) is obtained as follows. 

n{2Ri + R2) < 2/(Mi; yr) + I{M2]Y^) + nen 

< mm{I{M,-Yl\ Y^^ ,T^\T^), IiMr,Y^ ,T^\T^)} 
+ min{/(Mi; y,", Y,^, I{Mr,Yl)} 

+ min{/(M2; Y,^, Y^ , TJ^), /(M2; Y^, T^)} + nen 
= min{/i, /s} + min{/6, h} + min{/io, /12} + nen 

< mm{H{T^) + nH{Y3,Yi\Ti,T2, Q),H{T^) + nRo + nH{Yi\Ti,T2,Q)} 
+ Tnin{nH{Y3X\Q) " H{T^),nH{Yi\Q) - H{T^) + nR^} 

+ mm{H{T^) + uHiY^, Yi\T2, Q) - H{T^), H{T^) + nH{Yl\T2, Q) - H{T^) + ni?o} 
+ nen 
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= n{mm{H{Y3, Yl\Ti,T2, Q), H{Yi\TuT2, Q) + Rq} 
+ Tnin{H{Y:,,Yi\Q)^H{Yi\Q) + RQ} 
+ min{F(y3, Yl\T2, Q),H{Y^\T2, Q) + Rq} + e„). 
Similarly, we can obtain inequality (8). This completes the converse proof for Theorem ■ 
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